This piece was created as an exploration into my own auditory synesthesia. For people that do not experience any form of synesthesia, the idea of hearing colors is often confusing and hard to explain. However, computers experience an image in the same way that they experience text or sound files, and can therefore be used as a translator of sorts; images, sounds, text, and even 3D models can be presented as another type of file entirely.

This particular piece began its life as a 3D scan of myself. After the scan, I recorded audio of of myself talking and describing different aspects of myself physically, mentally, and socially. This audio recording was converted into a plain text file containing all the audio data, and the same was done for the image file containing all the texture and material information for the 3D model. Combining these two text files and resaving the result back to an image format, the audio data alters and displaces the color information of the image. Applying the new image to the model as its material lets us see the result and helps to serve as an approximation of how auditory synesthesia can be experienced by people who typically don't.